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ABSTRACT . iy 
An-analysis was performed of multipl2-choice tests in 
terms of the frequency theory of recognition memory. High and low 
ability children listened to sentences under different instraoctional 
sets (imagery rating ‘and sentenge repetition) and were later tested 
with maltiple-choice alternative: (1) either identical or similar in 
meaning to the originally presente crect items, and (2) either ‘ 
including or not previously presented irrelevant information. Th? 
sources of interference anticipated from the theory were eviient in 
both experiments. Moreover, instructional sets moderated frequency 
effects in the anticipated manner for lower ability children. 


Theoretical and educational implications are discussed. (Author) # 
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‘Processes Affecting Children's Learning .— | Se: 
\ . 


from “Sentences” 


a) ee : <* ear ay $26 ie 
: oF ' _'  Qhe reséar¢h which I shall report deals with processes ~/ 


-- involved in children's, recognition memory for information 


- contained in sentences. ‘In this research ‘we have utilized 


* a° recognition test’ procedure closely Pecunia the multiple 
d 
henge tests commonly found in schools. I shall first “4 


deseribe the rationale and general procedure utilized in’ the a, is 3 

7 ; research’ and ‘then describe the results of two experiments 

eh ‘conducted thus far, —. ef _ ° 
Typically, children (4th and 5th graders) listen to 


20 unrelated, ,complex sentences such as The lady showed. her 


‘ticket and demanded the seat. ‘They are ‘then tested 24 hours 
—=, See ee . 
ce - later for thein retention of the contents of the sentences. ae 

By systematically manipulat#¥hg the form of the correct 
Me alternatives and the nature of the incorrect alternatives 
-on the recognition test items we hoped to be able. to assess - 


children's degree of comprehension of the original material 


and to identify sources of interference in Memory. 
”“~ . 


Manipulations of Correct Alternatives . .. ‘é 


- The rationale underlying our manipulations of, the form 


A 


of the correct alternatives in’ test items derives from 

Richard Anderson's (1972) suggestion that questions based 

on paraphrases-<--rather than verbatim copies---of the avteinaiiy ! 
* presented material will distinguish between students whs | 


have truly comprehended the material’ and those who have not. a 


Po ss 


5 ; 7 : es ‘ : y ‘ , 7 % . ; « 

**. Anderson's remarks and research have, focussed on questions 
‘designed to: eciGte shor}-answer recall on*the part of 
ipiudents.. In our ‘eseatch using multiple-choice recognition oe " 


tests we haye incorporated Anderson's paraphrasge-verbatim 


-manipulation by includilng among ‘test item options either 
. - . Be ire r ; , 
. the verpatim-correct word from the original Sentence %r. a 


synonym substitution. For example, (see Table ]. in your 


g handouts) ‘for: the, sentence, The lady showed her ticket and 


demanded the seat, the item stem is the same in all condi-~ 
tions (e.g. What did ots ady ‘demand?§ but for verbatim items 


* the correct -alternative is the seat and fy synonym items 


" 
| ve F ‘ ’ 


| ; i i t 
the -corrett alternative is the chaix. We would expect 


a ‘chiddren who have:-fully comprehended the priginal sentences 
; : .! \ . -_ ‘ 
to do better on the synonym variations than children who at 
ub 


comprehended them less welt. oven performance for | 
3 “ y 
jects differing on comprehension should not differ for the | 


: ° 7 ee i eT 
- verbatim itefns. & :; ‘ 
l | 


\ : - e 


Manipulations of Incorrect Alternatives . R 


The rationale mndeetying our manipulations of the Rs 


nature of incorrect alternatives oh the recognition test | 


' > . 


derives from the frequency theory o recognition memory 

(Underwood, 1972). Briefly, the najox tenet of eee eee ‘ | 
is that’ recognition decisions are based on subjective 
_frequency differentials between old and new items--the old 


J items Hoey a frequency of i and new-items a Frequency ' = gi ' 


~ 


4 ae : | ‘ ‘ 


: ? ; . - a re 
- : , _ ac i 
Zz ‘ 


of 0. A straightforward prediction of the theory is that \~ 
including old-incorrect words from the sentences as Sistreckors 
on’ test items should produce jukerfereate as compared to 


itenis in which all distractors are “new joedi For example, 
*. 


‘(see saiadaees 1 in handout) the test items (V-OP and S-OP) jwhich. 


“contain the old-incorrect: alternative’ (the ticket) ree }e 


~*~ ‘4 . ! , ~ : | J 
produce more errors than test items I¥e0R 5. and ‘BrOB) which , 


. { 


do not contain this old information adcording ks frequency 


theory. On the other hand, if subjects are engaged in pros ~ 
cessing the meaningsof sentences as a nigte, Chel perhaps = 
frequency does not play a role in recognition of information’ 


conveyed in. sentences. . aaa | . . 
a ; ‘| ¥ * 


| 

ienipulations of correct sna inewtzeek alternatives, 
thus resulted in four test-item types ea duoien Si Table 
1--V-OA,°V-OP, S-OA and S-OP), with 5 sentences being tested 

\ means of each test-item type. Four test versions wake gat 
created with sentences being rotated through test-item types. 


, { P . 
As shown in Table 1, for half of the sentences, . a "what" 


‘ 


question waS appropriate. For the other half a ttieheh question, 
was ea Each sentence was constructed so that it . 


contained a word which was a plausible but incorrect response 


w 


to the later test question. The sentences were preg&ented to j 
dobjents via atape recorder at a seven-second rate. A ony 
later the questions ‘and responses were read to subjects 

while they followed ‘along on printed tests.. Subjects circled 


a response for each question.-; To alert subjects to the 


- 
baal 


_synonyn options they were told to circle fin answer even a pt eb ee 
— if it cag not e azacely the same as the word that. was ised Le 


on the previous dave-ae long as it meant the same thing. 


’ ‘ a a ‘ 
. - ’ 
e u ‘ . 


Experiment I oe. oe 
A 3 Fe ; : \ 
5 i ‘ 


The first experiment that. we conducted represented | : a 


Ah - an initial attempt to test the notions that: (1) subjects : 


with good comprehension £ the original materi al would perform 


~~ 8 


oy better than subjects: with’ \poor ‘comprehension, on synonym ee 


* but not verbatim items, and (2) poor comprehenders _ 

would: wk more sysceptible © than good comprehenders to inter-" 
ference from old-incorrect information. We attempted tg a 
_vary ole of compréhension’ by using ‘an jnidantat ‘cana’ 
ing format with different orienting tasks. In the repe- | . | 
tition condition, ‘subjects weve told to listen for a pause - 


* 


bi, zo in each sentence and then to repeat the sentence.aloud ‘ 


a 


"exactly the same way" the speaker had said it. In.re- 
cording the sentences the speaker inserted a notigesnia 
4 pause at one predetermined clause boundary within each 
sentence. ‘subjects: in the sii a condition were fain to ‘ 

Be rate ‘each sentence on its imageability. It was expected 


\ : that these imagery and repetition igstructions would orient 


oe ; subjects respectively toward aa jAway from the semantic . & a = 


2 ef POs content of the G duacigiale Twenty, Ss SeauaLS divided be- , 
tween fourth and fifth geAaHa) were randomly ‘assigned to ‘ ; 


~ “each instructional condition. % ; d 


. £ 3 : : . 
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” *. ‘ Results” + Mg . "4 _ 
as ‘results of Experiment 1 providea encouragenent 


was: worse on, aynonyn items than on “verbatim items for al 
ot subjects. Moreover’, the larges 
-: sas and epetition subjects eanureed on synonym items. How 


evey, instructions did not interact _with item ae Also, 


Ke . 


both instructignal eandliéionw: 


"Mg 
‘ af , 
memory for ‘sentences (ag well. as in sinple word reco ition 
ta situations) . . ~ my  « ‘ / 
| oa / 
| -1 * hat the’ instructional variable did not interact as 


expected with item type is perhaps not ‘too surprising’ 


when one Rona sGRnE that the experiment was: conducted in a 


university community school eee wee over-represented by 


\ pigh achieving students. . Our repetition insthuctions may. 


7 


not have been powerful enough to induce nonsemantic pro- 


_ cessing of sentence materials in this population of students 


Experiment 2 


In Experiment 2, we remedied this problem by sampling 
? e: Bs soe 
from a rural school that contained students spanning-da wide 


range of academic achievement. Forty children from two. - 
bs ors @ 


combined third-and fourth-grade classrooms were randomly 


‘ assigned (in equal numbers) tojthe two instructional 
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a 6. 
| . : 
¢ §conditions (repetition and imagery). After the expeninent 
was completed,: the children Were divided into "high" and - 
"Low" achievement gr ups|qn the basis of their being above” 


or below the nationa meHian’ on available standardized 


schisvensne Kastuine rma ion (ive., STEP ‘and Cooperative 

Primary) . Coinciden ail it was found that exactly half of 

the students were above nd half jaca wets However, due 

by dthe pibtewadenl ments) division of the children, slightly oa 
different numbers of students ended. up in the four Achievemént 
byginspArctions groups that were rorbya (two had, 11 and two 


had 9). . : : | a? \ 


> 


é The predictions se Vishense! nadextor Experiment’ 1, 

_ only now good and poor pan eee en fedndexed an two ways: 
High versus low achievemen levels and Imagery versus Repe~ 
tition instructional coridi ions. 

Results 7 | pe : % - ) 
The mean number of errors, expressed as percentages 

are presented for each item ‘type in Table 2 of your handout: 
A 2(achievement level) X 2 (instructions) analysis of variance 
was carried out for each itv type. For ‘both verbatim item 
buses (V-OA and V-OP) there was no significant difference © 
betweerl low and high sohievere nor was ere a significant 
difference between repetition and imagery. In contrast, . 
there was a significant difference between high and low ~- 
achievers for the S-OA item type (t(36) = 2.09, p « 05) 


and S70P item type (t(36) = 2.57 p < .05), 


. 


¢ 8 . ‘ 


« 3 
Pp * y 7 . > 
s : « . ’ 
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A significant ai tference between instructional conditions és 0 
was found only for the S-oP iteg type (t(36) = 2.70 p< hs | 
Hence, given the asstimption that low achievers are less in- a | 
clined than are high achievers to PROSeee the to-be-learned | 
‘material, semantically, eyngnye items, but not verbatim items - . 
BEONaAE a valid dssessment of comprehensién. In the. sudaent . 
sample, the presumed Che EeERNees in. processing by high and ! 

low achieving students is mimicked (although not perfectly) 

by instruétiona] ‘conditions which presumably ‘vary in the 

eéfictones of semantic processing they induce. a 


@ -With respect to interference effects, the results dis- 


played in Table 2 are less clear. There is an overall tendency 4 


a 


toward more errors on gidepresene items. However, this in- 
crease is not systematically modified by achievement level 
or instructions. However, an interesting finding emerges | 
when one considers the types of errors made on.the old-present 
“dean type (i.e.,.S-OP) which differentiates between high- and 
ee ee ae In Pable 3 of your handout is presented the 
mean percentage of all S-OP errors that favelived the familiar 
distractor. .To analyze these error patterns} for each child a 
difference between "old" and "new" errors was computed. 
These data were then analyzed ina yx 2 ANOVA. Consistent 
with. the picture portrayed in Table 3, giveri that an S-OP | 
error was made, low achievers were much moré likely -than 
high achievers to select the familiar distractor (t (36). = 


2.64; p <.01). ‘Neither the instructions effect nor the inter- 


. action approached significance... 


Conclusion , 2 


Two tentative conclusions are supported by the 


present ee & i . ee — 
‘ # : ; ns , 
: 4 Synonym correct alternatives in multiple- 


~~ . 


choice tests discriminate between students who process a 


. 


Oo. original | material at the level of comprehension 
and students who do not., Further research is directed 4 
toward substantiating this conclusion ky sampling 

‘ children of even lower ability levels than used 


currently. 


, om , 
2. Interference effects predicted by frequency theory ) 


aa 
do occur in recognition tests following sentence 


learning. Moreover, the detrimental effects of ins’. 
a cluding familiar distractors appear to be dispropor- 


tionately high for low achieving students. The 


significance of this finding is that including such 3 


familiar adatrackers in multiple-choice | tests results 


in bias toward low achieving students. That is, low 


- 


achieving children who are most likely to make an error 


- 


sme 2 “on a synonym item are also drawn systematically to the 
/ 


‘ ‘ 


familiar distractors. A disturbing implication from 
frequency theory (as yet untested) is that "old" errors 
are likely to persist in long-term memory to the 


potential detriment of low-achieving students. 


10 | 
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| 
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4 
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- 


"Institute of Education and no ‘official endorsement by the 
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ee B. £5. ns -  . Pable 1 \ 
; 2 _ Illustrations of Sentences and Test Items 
Study Senterice: “The lady showed ‘the ticket and demanded the seat. 

ee Test. Stem: What did the lady demand? i | , ’ aa 

; Response Options: . a ee Kiss ars : He! 

is . ee (V-OA) mn ca: a (v-0P) ; on (S=OA) “93h 

: - Verbatim-Old Abst. Verbatim-Old Present | Synonym-01d ‘Absent 

, a the seat THE ‘te the séat . the .chair . 
the money ghe ticket . ; the money , 
_thé “¢elephone a the telephone . a the telephone 


»/pStudy. Sentences The lawyer swore that the richman slapped , the actor. 


Ba A es Pe te “s nibs fey" 3 ve » 4 
: ae ee Who slapped, the. actor? se 


_ Response options: : 
: “Verbatim-Old Absent’. - Verbatim-o1d Besant’, “Byaonyie Ghd Absent 


“oe 


23 the richman -. _ the Signa. the millionaire 
the director *. “he: Lawyer - the director 
the elise 2 | : | the pilot ae . .the pilot * 
egy 3 eh ee 
» , * : 
“13 
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‘-(S-OP) . 
Synanynaois Present 


the chair! 


the ticket ' 


f 


the telephone | 


fa 


bs 


Synon¥m-Old Present, 


the millionare . 
the ‘lawyer 


the pilot 
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Mean Percentace.of Errors on Each Item Type 


Verbatin - Olé Absent 


Imagery Rexetition 
‘High 37.8 (29.b,  § 
Low , 47.3 ve ON 


ynonyn - Old Absent 


é Imagery Revetition 
High 35,6. 50.9 
‘Low 47.3 64.4 


Verbatim’ - Old Present 


bal 


Vo = id 
Imacery Revetition 


“$74g,8 49.1 
a ae oan 


“ 


Synonym - ‘Old Present. 
a 
Imagerv Revetition 


wo "86.7 © + 45.4 


>" 86.4 tl 
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Table 3 4 8 
. Mean Percentage of Errors Involving Familiar Distractors 


(Synonym-Old Present Item Type) 


a 


7 . Imagery Repetition 
High 38.1 48.1 
Low | 64.5 75.0 aa 
se 5 i 4 
0 XM , ~ 
-® 


